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AMENDMENTS TO THE CLAIMS: 



1 . (Currently amended) A predictive model method, comprising: 

receiving an first input data into an initial model to develop an initial model output; and 
receiving both of G oid second i nput data and said initial model output as inputs data into a 



first troBpform/rogrcssion boosting stage to develop an improvement to said initial model output 
said secon d input data comprising one of said first input data, data not included in said first input 
data, and a combination thereof 

2. (Currently amended) The method of claim 1, further comprising: 

providing an output of said first tjoncform/regression boosting stage as an first of two 
inputs into a second transformfregroGGion boosting stage^ 

wh e r e in a oocond of o aid two inputs compris e s said input data into oaid initial model. 

3. (Currently amended) The method of claim 2 1, further comprising: 

successively providing, for one or more additional boosting stages, an output of a 
preceding transfonn/r e grcssion boosting stage as an first of two inputs into a aext 
tnmaform/r e gr es sio fl succeeding boosting stage?. 

wherein a o e cond of oaid two inputs comprioos said input data into said initial modoL 

4. (Currently amended) The method of claim 1, wherein said first tronoform/regr e s s i on boosting 
stage comprises a transform/regression stage that comprises : 

a feature transform stage receiving said second input data and said initial model output; 
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a linear regression stage receiving an output of said feature transform stage; and 

an output summing node receiving as inputs said initial model output and an output of 

said linear regression stage, an output of said output summing node comprising a first boosting 

stage model output. 

5 . (Currently amended) The method of claim 4, farther comprising: 

successively providing, for one or more transform/regression stages, an output of a 
preceding transform/regression stage as an first of two inputs into a next succeeding 
transform/regression stage^ 

wh e rein a second of said two inputs comprio e s said input data into said initial model 

6. (Currently amended) The method of claim 5, wherein for eaeh at least one said one or more 
transform/regression stages, a third input into said next succeeding transform/regression stage 
comprises an output of said linear regression stage of said a preceding transform/regression 
stagey, and, for oaoh said tranaform/rogrosaion stag e , an output of said lin e ar r e gr e osion otage for 
said linoar r e gr e ssion stage is carried forward to bo on input into all successive) 
transform/r e gr e ssion stages, 

7. (Currently amended) The method of claim 5, further comprising: 

avoiding an overfitting in said predictive model by determining when a successive 
transform /regression stage does, not add to a performance of said predictive model. 
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8. (Original) The method of claim 7, wherein said determining of performance degradation 
comprises a holdout method, said holdout method comprising: 

dividing an available data into a training set and a holdout data set; 
using said training set to estimate a model parameter and to construct an alternative 
model structure; and 

using said holdout data set to make a selection among said alternative model structure. 

9. (Original) The method of claim 7, wherein said determining of performance degradation 
comprises a cross-validation method, said cross-validation method comprising: 

dividing an available data into a plurality of folds of data; and 

successively, using each said fold as a holdout data set, and a remaining data not in said 
fold is used as a training data set to estimate model parameters and to construct alternative model 
structures and said training data set is used to make a selection among said alternative model 
structures. 

10. (Currently amended) A predictive modeling method, comprising: 

establishing an initial model module to instance an initial model; and 

establishing a boosting stage model module to instance a boosting stage model for each 

of a plurality of one or more successive boosting stages, 

wherein eaeb at least one instanced boosting stage model receives, as m input, an input 

data and an output from at least one of said initial model and a preceding boosting stage models 

and caoh said ins tan cod stag e mod e l provides a stag e modol output that io uood ao an input into 

any n e xt o uccoooivo instanced stage mod o l. 
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1 1 . (Currently amended) The method of claim 10, wherein eaeh at least one said boosting stage 
model feeds forward a second output as another input into eti at least one succeeding boosting 
stage models.T 

1 2. (Currently amended) The method of claim 1 0, further comprising: 

instancing said initial model; 

instancing a firot atago modol that r e c e ives an output data from oaid initial model aa on 
input data and to provido a first otage model output; 

successively instancing one or more of said boosting stage models to be successive 
boosting stage models, wherein a first succ e ssiv e stage mod e l roc o ivoo ooid first stag e output data 
as an input data and provides an output data to be an input data to a oocond ouccc s siv c stage 
model, if any, and e aoh successive Gtag e model, if any, r e ceives a stage output data from an 
imm e diately preceding succ e ssive stago mod e and caoh>Quooossive stage model provid e s a stage 
output data to become an input data to a next succ e ssiv e stag e modol at least one said boosting 
stage model receives, as input, an output from at least one of said initial model and a preceding 
boosting stage model : and 

providing an input data as inputs to said initial model , said first otag e , and each said 
successive stage modoL ; and 

for each successive boosting stage model, providing an input data as input to said 
successive boosting stage model. 
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13. (Currently amended) The method of claim 12, further comprising: 

determining when an additional successive boosting stage would not add to a 
performance of the predictive model. 

14. (Original) The method of claim 13, wherein said determining of performance degradation 
comprises a holdout method, said holdout method comprising: 

dividing an available data into a training set and a holdout data set; 
using said training set to estimate a model parameter and to construct alternative model 
structures; and 

using said holdout data set to make a selection among said alternative model structures. 

15. (Original) The method of claim 13, wherein said determining of performance degradation 
comprises a cross-validation method, said cross-validation method comprising: 

dividing an available data into a plurality of folds of data; 

successively, using each said fold as a holdout data set, and a remaining data not in said 
fold is used as a training data set to estimate model parameters and to construct alternative model 
structures and said training data set is used to make a selection among said alternative model 
structures. 

16. (Currently amended) The method of claim 10, wherein said boosting stage model 
comprises: 

a first data input port; 
a second data input port; 
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a feature transform stage receiving data from said first data input port and said second 
data input port; 

a linear regression stage receiving an output from said feature transform stage; 
a summing node receiving data from said first data input port and output data from said 
linear regression stage; and 

an output port receiving data outputted from said summing node. 

17. (Currently amended) The method of claim 16, wherein said boosting stage model further 
comprises: 

a second output port to provide said output data from said linear regression stage to be a 
second output from said boosting stage model; and 

one or more input ports to receive data from said second output port of preceding 
boosting stages to be input data into said feature transform stage. 

18. (Currently amended) An apparatus to perform a predictive modeling method, said apparatus 
comprising: 

an initial model module to instance an initial model; and 

a boosting stage model module to instance a boosting stage model for each of a plurality 
ef one or more successive boosting stages, 

wherein eaeh at least one said boosting stage model receives a data input and an input 
from a n imm e diat e ly preceding boosting stage model and provides an output to a n e xt 
succ ee ding stage . 
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19. (Currently amended) The apparatus of claim 18, further comprising: 

a controller to cause said initial model and each of a plurality of one or more said 
successive boosting stage models to be instanced and to interconnect said initial model and said 
plurality of successive boosting stage models; and 

a graphic user interface to allow a user to control said controller and said predictive 
modeling method, to input data into said initial model, and to one of display and print to one of a 
printer, a data file, and an application program the output of a final one of said successive 
boosting stage models. 

20. (Currently amended) A signal-bearing medium tangibly embodying a program of machine- 
readable instructions executable by a digital processing apparatus to perform a predictive 
modeling method, said instructions comprising: 

an initial model module to instance an initial model; and 

a boosting stage model module to instance a boosting stage model for each of a plurality 
of one or more successive boosting stages, 

wherein eaeh at least one instanced boosting stage model receives, as an input, a data 
input and an output from at least one of said initial model and a preceding boosting stage model? 
and each said instanced stage model provides a stag e mod e l output that io uged as an input into a 
n e xt ouoooooivo instanced stage mod e l , 

21 . (Currently amended) The signal-bearing medium of claim 20, wherein said instructions 
further comprise: 
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causing said initial model and each of a plurality of one or more said successive boosting 
stage models to be instanced and to appropriately interconnect said initial model and said 
plurality of successive boosting stage models; 

allowing a user to control said controller and said predictive modeling method, to input 
data into said initial model, and to one of display and print to one of a printer, a data file, and an 
application program the output of a final one of said successive boosting stage models; 

receiving input data; and 

allowing an output data of said predictive modeling method to be provided as output data, 

22. (Currently amended) A method of providing a service, said method comprising at least one 
of: 

providing an execution of a predictive modeling method, wherein said predictive 
modeling method comprises: 

establishing an initial model module to instance an initial model; and 
establishing a boosting stage model module to instance a boosting stage model for 
each of a plurality of one or more successive boosting stages, wherein ea6h at least one instanced 
boosting stage model receives, as an input, an input data and an output from at least one of said 
initial model or a preceding boosting stage model , and oaoh paid instanced s tag e mod e l provider 
a s tage model output that io uo e d ao on input into a next ouooeflaivo inotonood atago mod e l . 

23-24. (Canceled) 
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25. (Currently amended) A method of determining performance degradation in an iterative 
predictive modeling, said method comprising: 

dividing an available data into a plurality of folds of data; 

for each said fold, instancing an iterative predictive modeling method and associating it 
with said fold: 

successively, using each said fold within the iterative predictive modeling method 
associated with that fold as a holdout data set, and a remaining data not in said fold is used as a 
training data set to estimate model parameters, and to construct alternative model structures and 
said training data set is used to make a selection among said alternative model structures. 

26. (Original) A method for deploying computing infrastructure, comprising integrating 
computer-readable code into a computing system, wherein the code in combination with the 
computing system is capable of performing the method of claim 1. 
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